Papers by Duc Trung Vu
DWA-KD: Dual-Space Weighting and Time-Warped Alignment for Cross-Tokenizer Knowledge Distillation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing cross-tokenizer distillation methods are limited by suboptimal alignment across sequence and vocabulary levels. |
| Approach: | They propose a cross-tokenizer distillation framework that enhances token-wise distillation . they use dual-space entropy-based weighting to achieve precise sequence-level alignment . |
| Outcome: | The proposed framework outperforms state-of-the-art methods in large language models but has high computational and memory costs. |